Skip to content

ci: add Comfy-Org/evals as a cursor-review caller#25

Closed
mattmillerai wants to merge 1 commit into
mainfrom
ci/add-evals-cursor-review-caller
Closed

ci: add Comfy-Org/evals as a cursor-review caller#25
mattmillerai wants to merge 1 commit into
mainfrom
ci/add-evals-cursor-review-caller

Conversation

@mattmillerai

Copy link
Copy Markdown
Contributor

ELI-5

When cursor-review.yml changes, this workflow opens a version-bump PR in every repo that uses it. This adds Comfy-Org/evals to that list so it gets those automatic bump PRs too, now that it has its own cursor-review caller.

What this does

Add Comfy-Org/evals as a cursor-review caller so it receives automatic SHA-bump PRs when cursor-review.yml changes. The entry points at the standard caller path (.github/workflows/ci-cursor-review.yml, added in Comfy-Org/evals) with the empty-label convention, matching the other unlabeled callers.

Provisioning note

For the dispatcher to actually open bump PRs on evals, the token it uses (the Cloud Code Bot app) needs contents: write + pull-requests: write on evals — i.e. the app must be installed there. If it isn't, the push/PR to evals returns 403 and the loop downgrades it to a per-repo warning (it won't abort the fan-out). Installing the app on evals is a separate admin step.

Validated with actionlint (clean).

@coderabbitai

coderabbitai Bot commented Jul 9, 2026

Copy link
Copy Markdown

Warning

Review limit reached

You’ve reached a temporary PR review limit under our Fair Usage Limits Policy.

Your recent review volume is higher than typical usage, so adaptive limits are currently applied.

Next review available in: 16 minutes

Enable usage-based reviews in Billing to review now. Otherwise, wait until the next included review is available.
You're only billed for reviews past your plan's rate limits ($0.25/file).

How can I continue?

After more reviews become available, a review can be triggered using the @coderabbitai review command as a PR comment. Alternatively, push new commits to this PR.

To avoid repeated limits, reduce automatic review volume by pausing incremental auto-reviews earlier, using label-based review opt-in, excluding WIP or generated PR titles, or requesting reviews manually when the PR is ready. If your team needs uninterrupted high-volume reviews, an organization admin can enable usage-based reviews.

How do review limits work?

CodeRabbit enforces per-developer PR review limits for each organization. Most developers receive the normal plan review availability.

For paid Pro and Pro+ PR reviews, CodeRabbit uses adaptive limits for sustained high-volume activity. When a developer's recent PR review activity reaches the 95th percentile or higher among CodeRabbit users, additional reviews become available more gradually as earlier reviews age out of the rolling window.

Please refer docs for additional details.

Review details
⚙️ Run configuration

Configuration used: Organization UI

Review profile: ASSERTIVE

Plan: Pro Plus

Run ID: 024c98ac-b0ce-47ee-96d9-c059713bf02c

📥 Commits

Reviewing files that changed from the base of the PR and between df507e6 and 999c3de.

📒 Files selected for processing (1)
  • .github/workflows/bump-cursor-review-callers.yml
✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Commit unit tests in branch ci/add-evals-cursor-review-caller
✨ Simplify code
  • Create PR with simplified code
  • Commit simplified code in branch ci/add-evals-cursor-review-caller

Comment @coderabbitai help to get the list of available commands.

@mattmillerai mattmillerai added the cursor-review Multi-model cursor review label Jul 9, 2026
@mattmillerai

Copy link
Copy Markdown
Contributor Author

Closing unmerged — superseded by the variable-based caller list (internal ticket: the CALLERS array moves to the CURSOR_REVIEW_CALLERS repository variable, which is already seeded and includes Comfy-Org/evals with the same caller path). Note: evals won't receive bump PRs until the workflow change reading the variable lands; any missed bump is picked up by the next run or a manual workflow_dispatch.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

cursor-review Multi-model cursor review

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant